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Abstract 



Two important metrics for measuring the quality of routing paths are the maximum edge con- 
gestion C and maximum path length D. Here, we study bicriteria in routing games where each 
player i selfishly selects a path that simultaneously minimizes its maximum edge congestion Ci 
and path length Di. We study the stability and price of anarchy of two bicriteria games: 

• Max games, where the social cost is max(C, D) and the player cost is max(Ci,-Di). We 
prove that max games are stable and convergent under best-response dynamics, and that 
the price of anarchy is bounded above by the maximum path length in the players' strategy 
sets. We also show that this bound is tight in worst-case scenarios. 

• Sum games, where the social cost is C+D and the player cost is Ci+Di. For sum games, we 
first show the negative result that there are game instances that have no Nash-equilibria. 
Therefore, we examine an approximate game called the sum-bucket game that is always 
convergent (and therefore stable). We show that the price of anarchy in sum-bucket games 
is bounded above by C* ■ D* /(C* + D*) (with a poly-log factor), where C* and D* are the 
optimal coordinated congestion and path length. Thus, the sum-bucket game has typically 
superior price of anarchy bounds than the max game. In fact, when either C* or D* is 
small (e.g. constant) the social cost of the Nash-equilibria is very close to the coordinated 
optimal C* + D* (within a poly-log factor). We also show that the price of anarchy bound 
is tight for cases where both C* and D* are large. 



1 Introduction 



Routing is a fundamental task in communication networks. Routing algorithms provide paths 
for packets that will be sent over the network. There are two metrics that quantify the quality 
of the paths returned by a routing algorithm: the congestion C, which is the maximum number 
of paths that use any edge in the network, and the maximum path length D. Assuming there 
is a packet for each path, a lower bound on the delivery time of the packets is f2(max(C, D)) 
(alternatively, Q(C + D)). Actually, there exist packet scheduling algorithms that given the paths, 
they deliver the packets along the paths in time close to optimal 0(max(C, D)) (alternatively, 

o(c+d)) nana ins Eg. 

Motivated by the selfish behavior of entities in communication networks, we study routing games 
where each packet's path is controlled independently by a selfish player. We model games with N 
players, where each player has to select a path from a source to a destination node. The objective of 
each player i is to select a path that simultaneously minimizes two parameters: the congestion d, 
which is the maximum number of paths that use any edge in player i's path, and the path length 
Di. We examine two kinds of games: max games, where the player's cost function is max(Cj, Dj), 
and sum games, where the player's cost function is C, + Di. In each of these games, the player's 
objective is to selfishly minimize its cost in an uncoordinated manner. From the player's point of 
view, the minimization of the sum or max cost functions are justified objectives, since it is shown 
in [3] that player i's packet can be delivered in time 0(Ci + Di) (alternatively, 0(max(Cj, Di)). 

A natural problem is to determine the effect of the players' selfishness on the welfare of the whole 
communication network. In the max and sum games, the welfare of the network is measured with 
the social cost functions max(C, D) and C+D, respectively. The choice of these social cost functions 
is appropriate since they determine the total time needed to deliver the packets represented by the 
players. We examine the consequence of the selfish behavior in Nash equilibria, which are stable 
states of the game where no player can unilaterally improve her situation. The effect of selfishness 
is quantified with the price of anarchy (PoA) |16l .24], which expresses how much larger is the worst 
social cost in a Nash equilibrium compared to the social cost in the optimal coordinated solution. 
We study the existence of Nash equilibria and the price of anarchy for max games and sum games, 
where we find that these games produce different results with their own merits. 

1.1 Max Games 

First, we examine max games (the social cost is max(C + D)). We prove that every max game has 
at least one Nash equilibrium. The equilibrium can be obtained by best response dynamics, where 
a player greedily changes, whenever possible, the current path to an alternative path with lower 
cost. With best response moves the game eventually converges to a Nash-equilibrium. We show 
that the optimal coordinated solution is a Nash-equilibrium too. Thus, max games games have very 
good Nash equilibria. This observation is quantified in terms of the price of stability (PoS) [U E] 
which expresses how much larger is the best social cost in a Nash equilibrium with respect to the 
social cost in the optimal coordinated solution. Therefore in max games it holds that PoS = 1. 

We then examine the worst Nash equilibria. We bound the price of anarchy (PoA) in max 
games with respect to the maximum allowable path length L for the players in the network, and 
the number of nodes n in the graph: 

PoA = 0(L + logn). 
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We prove that this bound is worst case optimal (within additive terms). Specifically, we provide 
an example game in a ring network where the optimal coordinated social cost is 1, while there is a 
Nash equilibrium with cost O(L) = 0(n). 

1.2 Sum Games 

We continue with examining sum games (the social cost is C + D). Intuitively, sum games have the 
potential to give better price of anarchy than the max games because both parameters (C and D) 
affect the choices at all the time, even when one parameter is larger than the other. For example, 
the ring game that we mentioned above has price of anarchy equal to 1 in the sum game. However, 
we prove a limitation of sum games: not all sum games have Nash equilibria; there exist instances of 
sum games with a small number of players that do not have Nash equilibria at all. This limitation 
directed us towards exploring alternative games which are stable (have Nash equilibria) and have 
similar characteristics with the original sum games. 

We found such a game variation that we call sum-bucket game. In sum-bucket games the players 
are divided into log n classes, called buckets, according to the packet paths that they choose. Bucket 
k holds the paths of players with length in range [2 k , 2 k ~ 1 ). Suppose that player i's path is in bucket 
k. The normalized congestion of player i, denoted Cj, is measured with respect to the paths that 
belong to bucket k. The normalized length of player i's path is Di = 2 k ~ l — 1, (which is a factor 
2 approximation of the original length). Player i's cost function is Cj + Di. Thus, in sum-bucket 
games only players in the same bucket compete with each other, while players in different buckets do 
not interfere. The normalized social cost function is defined to be C + D, where C is the maximum 
normalized congestion in any bucket, and D is the maximum normalized depth of all paths. 

We first show that sum-bucket games always have Nash equilibria, which can be obtained with 
best response dynamics. We then examine the quality of the Nash equilibria. For every game 
there is a corresponding coordinated bucket routing problem. We can bound the price of anarchy 
PoA with respect to the normalized optimal congestion C and normalized path length D in the 
optimal coordinated solution. We obtain: 

( C* D* \ 
PoA = Oi , -log 2 raj 

Therefore, when either of C* or D* is small (e.g. a constant), the Nash equilibrium provides a very 
good approximation (within a poly-log factor from optimal) to the uncoordinated routing problem. 
In such scenarios, the price of selfishness is small. However, when both C or D are simultaneously 
large, the approximation becomes worse (though still typically lower than the PoA of the max game 
since the PoA is bounded by the smaller of C or D , where D < 2L). Nevertheless, even in these 
scenarios the PoA bound is tight in certain games instances. 

Sum-bucket games are interesting variations of sum games because they are stable, and they 
can be used to approximate solutions for the C + D social cost. For any sum-bucket game, there 
is a corresponding "original" coordinated routing problem where the objective is to minimize the 
social cost C + D without using buckets. It holds that C < C < C • logra and D < D < 2D; 
thus, C + D = 0(C • logra + D). In other words, the normalized social cost can be used as 
an approximation for the "original" social cost. Let PoA' denote how much larger is the worst 
equilibrium of a sum-bucket game compared to the optimal solution of the coordinated original 
problem (with respect to the social cost C + D). It holds that PoA' < PoA ■ logra. Consequently, 
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the observations that we made above for the PoA in sum-bucket games apply also with respect to 
the original routing problem. For example, when one of C* or D* is small (e.g. a constant), then 
the Nash equilibrium of the sum-bucket game provides a very good approximation (within a poly 
log factor from optimal) to the coordinated original routing problem. 

1.3 Related Work 

Routing games (on congestion) were introduced and studied in \22\ I26j . The notion of price of 
anarchy was introduced in [16]. Since then, many routing game models have been studied which 
are distinguished by the topology of the network, cost functions, type of traffic (atomic or splittable), 
nature of strategy sets, and kind of equilibria (pure or mixed). Specifically, pure equilibria with 
atomic flow have been studied in [H (5J HU [261 EI] ( our work fits into this category), and with 
splittable flow in [27[ EU [29J [30]. Mixed equilibria with atomic flow have been studied in [U El dHl 

[I2mO[ia[M[2ffl[2ll[2l],and with s P littable flow in [3 E] • 

To our knowledge there is no previous work that considers routing games that optimize two 

criteria simultaneously. Most of the work in the literature uses a single cost metric which is related 

to the congestion. A common metric for the player cost is the sum of the congestions on all the 

edges of the player's path (we denote this kind of player cost as pc') and the respective social cost 

is the cost of the worst player's path (we denote this social cost as SC') [5J [HI [281 EH1 E01 13T] . 

However, as we discussed before, in packet scheduling algorithms, the pc' or SC' do not govern the 

packet delays; max(Cj, D{) or Ci + Di govern the packet delay. 

Other combinations of player costs and social costs have been studied in the literature: player 
cost pc' and social cost C has been studied in [3 O O HUl HH H21 HS1 HH [2H EH [27] ; player cost 
Ci and social cost C has been studied in [4j; other variations have been studied in [l3" l fl9 l 120 1 126] . 
The vast majority of the work on routing games has been performed for parallel link networks, 
with only a few exceptions on general network topologies [H [5l [6], [2~T] . 

Our work is closer to [I]. We extended some results presented in [1] to apply to bicriteria, 
instead of the single criterium of congestion, player cost Ci and social cost C, that was used 
in [1] . Specifically, the particular techniques that we use to prove existence of Nash equilibria with 
best response dynamics, and also to prove upper bounds on the price of anarchy, were originally 
introduced in [4]. Here, we modified and extended appropriately these techniques in a non-trivial 
way to apply to our new cost functions. 

Outline of Paper 

We proceed as follows. In Section [2] we give basic definitions. We study max games in Section [3] 
and sum games in Section 01 We finish with our conclusions in Section [5j Due to space limitations 
some proofs have moved to the appendix. 

2 Definitions 

An instance of a routing game is a tuple 1Z = (N, G,V), where N = {1, 2, . . . , N} are the players, 
G = (V,E) is a graph with nodes V and edges E, and the graph has paths V = (JieN^'*' where 
Vi is a collection of available paths in G for player i. Each path in Vi is a path in G that has the 
same source U{ £ V and destination Vi 6 V; each path in Vi is a pure strategy available to player 
i. A pure strategy profile p = \pi,P2, • • • ,Pn] 1S a collection of pure strategies (paths), one for each 
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player, where pi € Vi- We refer to a pure strategy profile as a routing. On a finite network, a 
routing game is necessarily a finite game. 

For any routing p and any edge e £ E, the edge- congestion C e (p) is the number of paths in 
p that use edge e. For any path p, the path- congestion C p (p) is the maximum edge congestion 
over all edges in p, C p (p) = max eep C e (p). We will use the notation Cj(p) = C Pi (p), for any 
user i. The network congestion is the maximum edge-congestion over all edges in E, that is, 
C(p) = max e gE C e (p). We denote the length (number of edges) of any path p as For any user 
i, we will also use the notation D Pi (p) or Di(p) to denote the length \pi\. The longest path length 
in V is denoted L(V) = max pe p \p\. We will denote by D (p) the maximum path length in routing 
p, that is -D(p) = maxpgp \p\. When the context is clear, we will drop the dependence on p and 1Z 
and use the notation C e , C p , Ci, C, L, D p , Di,D. 

For game R and routing p, the social cost (or global cost) is a function of routing p, and it 
is denoted SC(p). The player or local cost is also a function on p denoted pcj(p). We use the 
standard notation p_j to refer to the collection of paths {p±, ■ ■ ■ ,pi-±,pi+i, ■ ■ ■ ,pn}, and (pf,p-i) 
as an alternative notation for p which emphasizes the dependence on pi. Player i is locally optimal 
in routing p if pcj(p) < pcj(p-;p_j) for all paths p\ € Vi- A routing p is in a Nash Equilibrium 
(we say p is a Nash-routing) if every player is locally optimal. Nash-routings quantify the notion 
of a stable selfish outcome. A routing p* is an optimal pure strategy profile if it has minimum 
attainable social cost: for any other pure strategy profile p, SC(p*) < SC(p). 

We quantify the quality of the Nash-routings by the price of anarchy (PoA) (sometimes referred 
to as the coordination ratio) and the price of stability (PoS) . Let P denote the set of distinct Nash- 
routings, and let SC* denote the social cost of an optimal routing p*. Then, 

PoS = mf „1 ' , PoA= sup „1 . 
P e p SC* ' pe p SC* 



3 Max Games 

Let 1Z = (N, G,V) a routing game such that for any routing p the social cost function is SC(p) = 
max(C(p), -D(p)), and the player cost function pcj(p) = max(Cj(p), -Dj(p)). We refer to such 
routing games as max games. First, we show that max games have Nash-routings and the price of 
stability is 1. Then, we bound the price of anarchy. 



3.1 Existence of Nash-routings in Max Games 

We show that max games have Nash-routings. We prove this result by first giving a totaly order 
for the routings using a form of lexicographic ordering. Then we show that any greedy move of 
a player can only give a new routing with smaller order. Thus, the greedy moves will converge 
either to the smallest routing or to a routing where no player can improve further. In either case, 
a Nash-routing will be reached. 

Let TZ = (N, G, V) be a max routing game. Let r = max(iV, L). For any routing p we define the 
routing vector M(p) = [mi(p), . . . ,m r (p)], where mj(p) = a^(p) + 6j(p), and ctj(p) is the number 
of paths with congestion i, and h(p) is the number of paths with length i. Note that if SC{p) = k 
then / and m' k = for all kl > k. 

We define a total order on the routings as follows. Let p and p' be two routings, with M(p) = 
[mi, . . . , m r ], and M(p') = [m^, . . . , m' r ]. We say that M(p) = M(p') if mi = m\ for all 1 < i < r. 
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We say that M(p) < M(p') if there is a j, 1 < j < r, such that m^ = m' k for all A; > j, and 
mj < m^-. We order the p and p' according to the order of their respective vectors, that is p < p' 
if and only if M(p) < M{p'). Note that for any two p and p' it either holds that p = p' or p < p' . 
That is, the routings are totally ordered. 

Consider an arbitrary routing p. If p is not a Nash-routing, there is at least one user i which 
is not locally optimal. Then a greedy move is available to player i in which the player can obtain 
lower cost by changing the path from pi to some other path p\ with lower cost. In other words, 
the greedy move takes the original routing p = (pf, p_j) to a routing p' = {p[; p'_J with improved 
player cost pci{p') < pq(p), such that pi is replaced by p\ and the remaining paths stay the same 
(p_i = p'_j). We show now that any greedy move gives a smaller order routing: 

Lemma 3.1 If a greedy move by any player takes a routing p to a new routing p' , then p' < p. 

Proof: Let pa(p) = max(C i (p), A(p)) = ^f ax , and min(Q(p), A(p)) = kf n (clearly, /cf ax > 
kf in ). Let also pej(p') = max(C i (p / ), A(p')) = fc f ax , an d min(C i (p') 1 A(p')) = k f n (clearly, 
^.max y &™ m ). Since player i can decrease its cost in p', A;™ ax < fcf 1 ^. Consider now the vectors 
M(p) = [mi, . . . , m r ] and M(p') = [m' x , . . . , mj,]. These two vectors are the same except possibly 
for entries fc™ 8 "*, fc™ m , £;™ ax , /c™ m , which correspond to the positions that are affected by paths p, 
and j^. It holds that m^max > m^. max , since when the path switches to p^, = a^p + fe^max 

decreases by at least one because either a^max decreases by one (if the new path has lower congestion) 
or frfcmax decreases by one (if the new path has lower length). Since fc™ ax < kf 13 *, M(p) > M(p') 
implying that p > p'. ■ 

Since there are only a finite number of routings, Lemma [3.11 implies that starting from arbitrary 
initial state, every best response dynamic converges in a finite time to a Nash-routing, where every 
player is locally optimal. Since the routings are totally ordered, there is a routing p m i n which is 
the minimum, that is, for all routings p, p m i n < p. Clearly, the minimum routing is also a Nash- 
routing. The minimum routing p m i n achieves also optimal social cost, since if there was another 
routing p' with lower social cost, then it can be easily shown that p' < p m i n , which is contradiction. 
Thus, the price of stability is 1. Therefore, we have the following result: 

Theorem 3.2 (Stability of max games) For any max game 1Z, every best response dynamic 
converges to a Nash-routing, and the price of stability is PoS = 1. 

3.2 Price of Anarchy in Max Games 

We bound the price of anarchy in max games. Consider a max routing game 1Z = (N, G, V), where 
G has n nodes. Theorem 13.21 implies that there is at least one Nash-routing. Consider a Nash- 
routing p. Denote C = C(p) and D = D(jp). Let p* be the optimum (coordinated) routing with 
minimum social cost. Denote C* = C(p*) and D* = D(p*). Note that each payer i£N has a path 
Pi S p and a corresponding "optimal" path p* £ p* from the player's source to the destination. 

For each edge e S G, denote II e (p) the set of players whose paths in routing p use edge e. We 
define H to be a set that contains all edges e £ G with congestion C e (p) > D + 2. Consider an 
edge e £ H. Let i £ II e (p) be a player whose path pi in routing p uses edge e. We define /(e, i) 
to be a set that contains all edges e' E p* with C e i{p) > C e (p) — 1. It holds that |/(e, i)\ > 1, 
since in routing p player i prefers path pi instead of p* because there is at least one edge e' £ p* 
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with C e /(p) > C e (p) — 1 > D. Let /(e) = U ign (p)/( e iO- For any set of edges X C H, we define 
/(X) = U ee x/(e)- 



Lemma 3.3 Lei Z 6e £/ie set that contains all edges e with congestion C e (p) > C — 21ogn. // 
C > D + 2\gn + 2, then there is a set of edges XCZ such that \ f(X)\ < 2\X\. 

Proof: We recursively construct a sets of edges E , . . . ,E 2 \ gn , such that E^ = U 
and set Eq contains all the edges e with congestion C e (p) = C . Prom the construction of those 
sets it holds that for any e 6 Ej, C e (p) > C — j, where < j < 21gn. Thus, Ej C Z, for all 
< j < 21gn. (Note that Z C F.) 

We can show that there is a j, < j < 21gn, such that |/(£j)| < 2|£j|. Suppose for contra- 
diction that such a j does not exist. Thus for all j, < j < 21gn, it holds that \f(Ej)\ > 2\Ej\. In 
this case, it it straightforward to show that \E^\ > 2\Ek-i\, for any 1 < k < 21gn. Since |-Eo| ^ L, 
it holds that |i?2ign| > 2 21gn = n 2 . However, this is a contradiction, since the number of edges in 
G do not exceed n 2 . ■ 



Lemma 3.4 // C > D + 2 lg n + 2, then C < 2LC* + 21gn. 

Proof: From Lemma 13.31 there is a set of edges X C Z with < 2\X\. For each e G Z it 

holds that C e (p) > C - 21gn. Let M = J] eeX C e (p) > |X|(C - 21gn), where M denotes the total 
utilization of the edges in X by the paths of the players in IL Let II = IJeex n e (p)> that is, LT is 
the set of players which in routing p their paths use edges in X. By construction, the congestion 
in routing p in each of the edges of X is caused only by the players in LT. Since path lengths are 
at most L, each player in LT can use at most L edges in X. Hence, M < L ■ \H\. Consequently, 
\X\(C- 21gn) < L • |n|, which gives: C < (L ■ |n|)/|X| +21gn. 

By the definition of f(X), in the optimal routing p* each user in n has to use at least one 
edge in f(X). Thus, edges in the optimal routing p*, the edges in f(X) are used at least n times. 
Thus, there is some edge e E f{X) with C e (p*) > |n|/|/pQ|. Therefore, C* > |n|/|/(X)|. Since 
|/(X)| < 2|X|, we obtain |H| < 2C* ■ \X\. Therefore: C < 2LC* + 21gn. ■ 

Theorem 3.5 (Price of anarchy in max games) For any max game 1Z it holds that PoA = 
0(L + logn). 

Proof: Suppose that p is the worst Nash-routing with maximum social cost. We have 
PoA = SC{p)/SC{p*). If C > D + 21gn + 2, then SC(p) = C. From Theorem E31 
PoA < C/max(C*,L>*) < (2LC* + 21gn)/C* < 2L + 21gn. If C < D + 21gn + 2, then 
SC (p) < D + 21gn + 2; thus PoA < L + 21gn + 2. Hence, in both cases PoA = 0(L + logn). ■ 

There is a max game that shows that the result of Theorem 13.51 is tight in the worst case. 
Consider a ring network with n nodes and n edges. Give the same orientation to the edges, so that 
each edge has one left node and one right node. For each edge ej, there is a corresponding player i 
whose source is the left node and the destination is the right node of the edge. The strategy set of 
each player has two paths: path pi which is only the edge e^, and path which goes around the ring. 
Note that p = [pi,P2> • • ■ ,Pn] is a Nash-routing with social cost 1. However, p' = [pi,P2> • • ■ ,Pn] is 
also a Nash routing with social cost n — 1. Thus, the price of anarchy is O(n) = O(L). 
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4 Sum Games 



Let R = (N, G, V) be a routing game such that for any routing p the social cost function is 
SC(p) = C(p) + D(p), and the player cost function pCj(p) = Cj(p) + A(p)- We refer to such 
routing games as sum games. We first show that such games have instances without Nash-routings. 
Then we describe a variation of sum games, that we call sum-bucket games, which are stable and 
their equilibria have good properties. 

4.1 A Sum Game without Nash-routings 

Theorem 4.1 There is sum game instance TZ = (N,G,V) that has no Nash-routing. 

Proof: The graph G is depicted in the figure below. There are seven players, namely, N = 
{1,...,7}. Players 1, 2, and 3, have respective strategy sets V\ = {pi,p[}, V2 = {P2,P2}> and 
Vz = {p3,P3j-- In the figure for player i = 1, . . . , 3 the respective source and destination nodes are 
Ui and Vi. There are six critical edges denoted ei, . . . , e% that the paths use and which are shown in 
the figure as straight horizontal lines. These edges may have congestion larger than 1. The squiggly 
part of the paths are assumed to have congestion 1 and their length and their lengths are chosen 
so that the following relations hold: \p[\ = \pi \ — 2, \p' 2 \ = \p2 \ + 3, and \p' 3 \ = \ps\ + 3. 



Players 4 to 7 are "passive" in the sense that they have only one path in their strategy sets, 
and their sole purpose is to create additional congestion on edges e3,e4,es,e6 (the paths of these 
players are not shown explicitly in the figure). In particular, the passive players cause additional 
congestion 1 to edge additional congestion 3 to e^ and e$, and additional congestion 4 to e%. 
The additional congestion is depicted in the figure inside a parenthesis under each edge. 

Since the only "active" players are 1, 2, and 3, and each player has two path choices, there are 
eight possible different routings. We examine each routing and prove that it is not a Nash-routing. 
We use the vector \pi,P2,P3] to denote a routing where the ith position of the vector contains the 
path choice of user i. By setting explicit values to the path lengths, and computing the player costs 
in each routing, we find that: player 1 is not locally optimal in routings \pi,P2,P3] and [p'liP^iPzYi 
player 2 is not locally optimal in routings [pi , P2 , P3] , [pijP^Pjs]) [Pi>P2>P3], and [pi , p 2 , P 3 ] 5 and 
player 3 is not locally optimal in routings [p'nP^iPz] and \p\,P2,p'^[- ■ 

4.2 Sum-bucket Games 

Here we describe sum-bucket games, which are variation of sum games that are stable and their 
equilibria have good properties. Let TZ = (N, G,V) denote a sum-bucket routing game. The paths 




e 4 (+3)"e 5 (+3) w e 6 (+4)' 
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in V are divided into buckets Bq, . . . , B\ g i so that Bk is a set that contains all paths whose lengths 
are in range [2 fc ,2 fc+1 ). (We use IgL instead of |~lg£] to avoid notational clutter.) For any path 
p G V, let B(p) denote the index of the bucket that p belongs to; namely, if p G B^, then B(p) = k. 

Consider now a routing p. We define the normalized length of path p G p as D p (p) = 2 B ^ +1 — 1 
(which is the maximum possible path length in bucket B(p)). Note that all the paths in the same 
bucket have the same normalized length. For any path p we define the normalized congestion C p (p) 
to be the maximum congestion on any of the edges of path p which is caused by the paths of routing 
p which belong to bucket B(p). 

Player i's cost is pci(p) = Cj(p) + Dj(p). The player is allowed to switch from one bucket to 
another. The normalized congestion of p is C(p) = max PiGp Cj(p), and the normalized length of 
p is D(p) = maxp. g p -Dj(p). The social cost of game 7Z is SC(p) = C(p) + D(p). Below, we show 
that sum-bucket games are stable and then we bound the price of anarchy 

4.2.1 Existence of Nash-routings in Sum-bucket Games 

Here we show that sum-bucket games have Nash-routings. We use the same technique as in Sec- 
tion [3J3 where we order the routings and prove that greedy moves give smaller order routings. Let 
1Z = (N, G,V) be a sum-bucket routing game. Let r = N + 2L — 1 (this is the maximum possible 
player cost). For any routing p we define the routing vector M(p) = [mi(p), . . . , m r (p)] such that 
mj(p) is the number of paths in p with cost j. We define a total order on the routings, with respect 
to their vectors, in exactly the same way as wee did for the max games in Section \3. 11 Using similar 
techniques as in the max games, we can prove that if a greedy move by player i takes a routing 
p to a new routing p', then p' < p. Since there are only a finite number of routings, every best 
response dynamic converges in a finite time to a Nash-routing. Therefore, we get: 

Theorem 4.2 (Stability of sum-bucket games) For any sum-bucket game 1Z, every best re- 
sponse dynamic converges to a Nash-routing. 

4.2.2 Price of Anarchy in Sum-bucket Games 

From Theorem l4.2l every sum-bucket game has at least one Nash-routing. Here, we bound the price 
of anarchy. Consider a sum-bucket routing game 7Z = (N, GjV), where G has n nodes. Consider a 
Nash-routing p. Denote C = C(p) and D = D(p). Let p* be the optimum (coordinated) routing 
with minimum social cost. Denote C = C(p*) and D = D(p*). Note that each payer i G N 
has a path in p, G p and a corresponding "optimal" path p* G p* from the player's source to the 
destination node. For any player i, let Si denote the shortest path in V which connects the source 
and destinations nodes of %. We now relate the paths lengths with the congestion: 

Lemma 4.3 In Nash-routing p, for any player i with Ci > C — x, where x > 0, it holds that 
\Pi\ < \si\ + x + 1. 

Proof: Suppose for the sake of contradiction that there is a player i with \pi\ > \si\ + x + 1. 
Then, pa = Ci + Di > C - x + A > C - x + \pi\ >C-x + |s»| + x + 1 = C + \si\ + 1. Clearly, 
\si\ < 2 B ( S ^ +1 — 1. If user i was to switch to path s« its cost would be pc[ < C + 1 + 2 B ^ +l — 1, 
since the normalized length of Sj is 2 B ( Si ^ +1 — 1, and Sj has normalized congestion at most C before 
player % switches, and the normalized congestion of path Sj increases to at most C + 1 after player i 
switches to it. Therefore, pc- < C + 1 + |sj| < pcj. Thus, in p player i would not be optimal, which 
is a contradiction, since p is a Nash-routing. Therefore, \pi\ < \si\ + x + 1, as needed. ■ 
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For each edge e G G let II e (p) denote the set of players whose paths in routing p use edge 
e. Let C ejPi (p) denote the number of packets that use edge e in p and are in the same bucket 
as pi. Let C e (p) = max Pi C etPi (p) denote the normalized congestion of edge e. For any edge e, 
we define f(e,i) to be a set that contains all edges e' G p* with C e /, P *(p) > C ejPi (p) — D . Let 
/(e) = Uj S n e ( p )/(e, i), and for any set of edges X, f(X) = U e gx/( e )- ^ can ^ e snown that in 
Nash-routing p it holds \ f(e,i)\ > 1. 

Lemma 4.4 Lei Z be the set that contains all edges e with congestion C e (p) > C — 2D* -lgn. 
There is a set of edges IC2 with \f(X)\ < 2|X|. 

Proof: We recursively construct a sets of edges Eq, . . . , -S^igm such that Ei = E{-\ U f(E^i), 
and set Eq contains all the edges e with congestion C e (p) = C. We can show that there is a j, 
< j < 2 lgn, such that \f(Ej)\ < 2\Ej\. Suppose for contradiction that such a j does not exist. 
Thus for all j, < j < 2 lgn, it holds that > 2|£^|. In this case, it it straightforward to 

show that \E k \ > 2\E k _ 1 \, for any 1 < k < 2 lgn. Since \E Q \ > 1, it holds that \E 2 \ sn \ > 2 21 § n = n 2 . 
However, this is a contradiction, since the number of edges in G cannot exceed n 2 . Thus, there is 
a j with \f(Ej)\ > 2\Ej\. We will set X = Ej. 

It only remains to show that X <Z Z. It suffices to show that for any E k and e £ E k , C e (p) > 
C -kD , where < k < 2 lgn. We prove this by induction on k. For fc = we have that every 
edge in e has C e (p) = C = C — • D , thus the claim trivially holds. For the induction hypothesis, 
suppose that the claim holds for any k = t < 2 log n. In the induction step we will prove that the 
claim holds also for k = t + 1. We have that Et+i = Et U f(Et)- By induction hypothesis, for any 
e G E t , C e (p) > C-tD* (thus, for any e €_fit it holds that C e (p) > C - (t + l)D*)). Thus, for any 
e G £fc there is at least one path with C e . Pi (p) > C — tD . By definition of f(e,i), every edge 
e G /(e, i) has the property that C e ', P * (p) > Ce,p, (p) — -D > C — (t + 1)D . Thus, there is at least 
one path p' £ p which is in the same bucket with p* (namely, B(p') = B(p*)) for which it holds 
that C e /y(p) = C e ' iP *(p). Therefore, C e '(p) > C — (t + 1)D . Consequently, from the definition of 
f{E t ) it follows that for any edge e' G /(-Bt) it holds that C e /(p) > C — (t + By considering 

the union of Et U f(Et), we have that the claim holds for any edge in e G -Et+i, as needed. ■ 

Lemma 4.5 /n Nash-routing p it ZioWs £/iat C < 18C* • • lg 2 n. 

Proof: From Lemma 14.41 there is a set of edges X C Z with |/(X)| < 2\X\. For each e £ Z it 
holds that C e (p) > C — 2D • lgn. Let II = IJeex n e (p)> that is, II is the set of players which in 
routing p their paths use edges in X. Let M = J2 e ex ^e(p), which denotes the total "normalized" 
utilization of the edges in X. We have that M > \X\(C — 2D* ■ lgn). 

By construction, the congestion in routing p in each of the edges of X is caused only by the 
players in II. We can bound the path lengths of the players in II with respect to D as follows. 
Consider a player i G II. We have that Cj(p) > C — 2D* ■ lgn. From Lemma [4731 and the fact that 
\si\ < D*, we obtain: \pi\ < |sj| + 2D* ■ lgn + 1 < D* + 2D* ■ lgn + 1 < AD* ■ lgn. Thus, the path 
length of every player in II is at most K = AD • lg n. 

M can also be bounded as M < K\Ii\. Consequently, |X|(C — 2D Tgn) < .K"|n|, which gives: 

C < m + 2D* ■ lgn = AW ■ |n| + 2D* ■ lgn. (1) 

I I I I 

Since |/(e, i)\ > 1, in the optimal routing p* the path of each user in II has to use at least one edge 
in f(X). Thus, in the optimal routing p*, the edges in f(X) are used at least |II| times. Thus, there 
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is some edge e G f(X) which in p* is used by at least |II|/|/(X)| paths. Since there are IgL + 1 
buckets, the normalized congestion of e in one of those buckets is at least |n|/(|/(X)| • (IgL + 1)). 
Therefore, C* > |II|/(|/(X)| • (IgL + 1)). Since |/(X)| < 2\X\, we obtain: 

|n| < 2C* ■ \X\ • (IgL + l) < AC* ■ \X\ -lgn. (2) 

By Combining Equations □ and El we get: C < 16C* • D* ■ lg 2 n + 2D* lg n < 18C* • D* ■ lg 2 n. ■ 

When C > D/4, using Lemma 14.51 it is straightforward to prove that PoA = 
0((C* ■ D* ■ lg 2 n) /(C* + IT)). If C < D/4, then using LemmaH31 we can prove that PoA = 0(1) 
(the details can be found in the appendix). Therefore, we obtain the main result: 

Theorem 4.6 (Price of anarchy in sum-bucket games) For any sum-bucket game 1Z it 
holds: 

I ' c* .75* \ 
PoA = O =j — =f ■ lg 2 n . 

\C +D J 

There is a sum-bucket game 1Z = (N, G, V) that shows that the result of Theorem l4.6l is tight in 
non-trivial cases. All the players have the same source node u and destination node v. Let a = s/N 
(suppose for simplicity that a = y/~N = \y/N ] ) . There is a path p of length a from u to v. There are 
a edge-disjoint paths Q = {q\, . . . , q a } from u to v so that each path % has length a and uses one 
edge of p. Each player has two paths in her strategy set: one is path p and the other is a path from 
Q. Further, for each path there are a players that have % in their strategy sets. Let p be the 
routing where every player chooses path p. Then, p is a N ash-routing with social cost a + N. Let p' 
be the routing where every player chooses the alternative path in Q. Then, p' is also a Nash-routing 
with social cost 2a. Thus, PoA > SC(p')/SC(p) > (a + N)/(a + 1) = Q{y/N) = Q(y/n). Routing 
p' is an optimum routing with the smallest social cost C = C(p) = a and D = D(p) = a. Thus, 
from Theorem EES! PoA = 0((C* ■ D* ■ lg 2 n)/(C* + 25*)) = 0(a ■ lg 2 n) = 0(^/E ■ log 2 n). Hence, 
the price of anarchy has to be within a log 2 n factor from the bound provided in Theorem 14.61 

5 Conclusions 

In this work we provided the first study (to our knowledge) of bicriteria routing games, where the 
players attempt to simultaneously optimize two parameters: their path congestion and length. The 
motivation is the existence of efficient packet scheduling algorithms which deliver the packets in 
time proportional to the social cost. We examined max games and sum games. Max games stabilize, 
but their price of anarchy is high. Sum games do not stabilize, but they can give better price of 
anarchy. We then give the approximate sum-bucket games which always stabilize and preserve the 
good properties of sum games. Surprisingly, arbitrary sum-bucket game equilibria provide good 
approximations to the original coordinated routing problem. 

Several open problems remain to examine. We studied two particular functions of the bicriteria, 
namely, the max and the sum functions. There are other functions, for example a weighted sum, that 
could provide similar or better results. It would also be interesting to add additional parameters. 
The original C + D sum games do not stabilize in general. However, there exist interesting instances 
which stabilize. For example, it can be easily shown that the games where the available paths have 
equal lengths always stabilize. It would be interesting to find a general characterization of the 
game instances that stabilize. Another interesting problem is to provide time efficient algorithms 
for finding equilibria in our games. 
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A Additional Proofs of Section 13.11 



Lemma A.l Minimum routing p m i n achieves optimal social cost, that is, SC(p m m) < SC(p), for 
any other routing p 7^ p m i n . 

Proof: Suppose for contradiction that there exists a routing p > p m i n with SC(p) < 5C(p m i n ). 
Let SC(p) = max(C(p),D(p)) = h, and 5C(p min ) = max(C(p min ), L»(p min )) = k 2 . Clearly, 
k% < k 2 . Therefore, in the vector M(p) = [mi, . . . ,m r ] it holds that 7^ and m& = for 
k > k\. Similarly, in the vector M(p m i n ) = [rhi, . . . ,rh r ] it holds that fhk 2 7^ and fhk = for 
k > k 2 . Therefore, M(p m ; n ) > M(p), contradicting the fact that p > p m i n - ■ 

B Additional Proofs of Section 14.11 

In the table below we calculate the congestions, path lengths, and player costs for each routing 
scenario of the game in Theorem 14.11 We set the specific lengths as: \pi\ = 10, \pi\ = 8, |je>2 | = 
7, \p' 2 \ = 10, |jp3 1 = 7, and \p' 3 \ = 10. For a player i £ {1,2,3} and routing p we define the 
complementary routing to be the one where player i chooses the alternative path. For example, 
for player 2 the complementary routing of [p\ , p 2 , P3] is \p% , p' 2 ,pz[. A player is locally optimal in a 
routing if the complementary routing does not give a lower cost for the player. Using the table it 
is easy to determine whether a player is locally optimal or not by examining the respective costs in 
the complementary routings. In this way, we find the non-locally players which are shown in the 
rightmost column of the table. 



routing 


Ci 


Di 


PCl 


c 2 


D 2 


pc 2 


c 3 


^3 


PC3 


Non locally optimal players 


[Pl,P2,P3] 


4 


10 


14 


4 


7 


11 


4 


7 


11 


player 1 




5 


8 


13 


5 


7 


12 


5 


7 


12 


player 2 


Ip'vP^Ps] 


5 


8 


13 


1 


10 


11 


5 


7 


12 


player 3 


IPvPz'P'sl 


5 


8 


13 


1 


10 


11 


1 


10 


11 


player 1 


\PUP2,Pz] 


2 


10 


12 


2 


10 


12 


2 


10 


12 


player 2 




3 


10 


13 


4 


7 


11 


2 


10 


12 


player 3 


\pl,p' 2 :ps] 


3 


10 


13 


2 


10 


12 


4 


7 


11 


player 2 


[P[,P2,P' 3 ] 


5 


8 


13 


5 


7 


12 


1 


10 


11 


player 2 



C Additional Proofs of Section 14.2.11 

Lemma C.l If a greedy move by player i takes a routing p to a new routing p' , then p' < p. 

Proof: Let p, t and p\ denote the paths of % in routings p and p', respectively. Let pcj(p) = 
Cj(p) + Di(p) = zi and pcj(p') = Cj(p') + -Dj(p') = z 2 . Since player i decreases its cost in p', 
z 2 < Z\. Consider now the vectors of the routings M(p) = [mi, . . . , m r ] and M(p') = [m^, . . . , m' r ]. 
We will show that M(p) < M(p'). 

Let B(pi) = k\ and B(p' i ) = k 2 . Let V denote the set of players whose cost increases in p' with 
respect to their cost in p. Next, we show that for any j G V it holds that pcj(p') < Cj(p'), which 
will help us to prove the desired result. 

Let pj be the path of j £ V. Let B(pj) = k% (note that j does not switch paths and buckets 
between p and p'). If k^ ^ k\ and k% ^ k 2 then the cost of j remains unaffected between p and 
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p'. Thus, either k% = k\ or k% = ki- If k^ = k%, then the cost of j can only decrease from p to 
p', since path pi can no longer affect path pj. Therefore, it has to be that k% = k?- Suppose, for 
the sake of contradiction, that pcj(p') > pcj(p'). Then, Cj(p') + Dj(p') > Cj(p') + A(p')- Since 
both paths are in the same bucket, Dj(p') = A(p')> which implies that Cj(p') > Ci(p'). Since 
j £ V, Cj(p) < Cj(p'). The increase in normalized congestion of pj in p' can only be caused by 
p\ because it shares an edge with pj with congestion Cj(p'). However, this is impossible since it 
would imply that Cj(p') > Cj(p'). Therefore, pcj(p') < pcj(p'). 

Consequently, in vector p' all the entries in positions j% + 1, • • • , r do not increase with respect 
to p. Further, because i switches paths, > m^. Thus, M(p) < M(p'), as needed. ■ 

D Additional Proofs of Section 14^21 

Lemma D.l In Nash-routing p, for every player i and edge e it holds that |/(e, i)\ > 1. 

Proof: Suppose that |/(e, i)\ =0. Then for every edge e' £ p* it holds that C e ' iP *(p) < C e)Pi (p) — 

D . Let C — max e ' e p* C e ' : p* (p). If player i was to choose path p* its cost would be: pc'^ < 

C' + 1 + D p * < C e>p .(p)-D* + 1 + D* = C e>p .(p) + 1 < Ci(p) + A(p) =pc l (p). Thus, pc / l < p Ci (p) 
which implies that player i is not locally optimal in Nash-routing p, a contradiction. ■ 

Proof of Theorem I4.6t 

Suppose that p is the worst Nash-routing with maximum social cost. We have that PoA < 
SC(p)/SC(p*) < (C + D)/(C* + D*). We examine two cases: 

• C > D/4: In this case D = 0(C). From Lemma ELTH C < 18C* ■ D* ■ lg 2 n. Therefore: 
PoA = 0(C/(C* + D*)) = O((0* ■ D* ■ lg 2 n)/(C* + D*)). 

• C < D/A: Let pi G p be the path with maximum cost in p. Clearly, pcj(p) = Cj + Di > 
~D. Further^ £_(7i(p) < C < D/A. Thus, A ^ D -Ci > D_-D/A = 3D /A. Since 
Ci > = C - C, Lemma K2\ gives \pi\ < \si\ + C + l<D* + D/A + 1. We have that 
D_i/2 <_\pi\. Therefore, A/2 < D* + D/A + 1, which gives: 3D/_8 <T5* + D/A + 1. Thus, 
D < 8(D* + 1) < 16D*. In order words, D = 0{D*). Since, C = D, we obtain: PoA = 
0(D/(C* + D*)) = 0(D*/(C* + D*)) = 0(1). 

By combining the two above cases we obtain the desirable result. ■ 
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Abstract 



Two important metrics for measuring the quality of routing paths are the maximum edge con- 
gestion C and maximum path length D. Here, we study bicriteria in routing games where each 
player i selfishly selects a path that simultaneously minimizes its maximum edge congestion Ci 
and path length Di. We study the stability and price of anarchy of two bicriteria games: 

• Max games, where the social cost is max(C, D) and the player cost is max(Ci,-Di). We 
prove that max games are stable and convergent under best-response dynamics, and that 
the price of anarchy is bounded above by the maximum path length in the players' strategy 
sets. We also show that this bound is tight in worst-case scenarios. 

• Sum games, where the social cost is C+D and the player cost is Ci+Di. For sum games, we 
first show the negative result that there are game instances that have no Nash-equilibria. 
Therefore, we examine an approximate game called the sum-bucket game that is always 
convergent (and therefore stable). We show that the price of anarchy in sum-bucket games 
is bounded above by C* ■ D* /(C* + D*) (with a poly-log factor), where C* and D* are the 
optimal coordinated congestion and path length. Thus, the sum-bucket game has typically 
superior price of anarchy bounds than the max game. In fact, when either C* or D* is 
small (e.g. constant) the social cost of the Nash-equilibria is very close to the coordinated 
optimal C* + D* (within a poly-log factor). We also show that the price of anarchy bound 
is tight for cases where both C* and D* are large. 
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1 Introduction 



Routing is a fundamental task in communication networks. Routing algorithms provide paths 
for packets that will be sent over the network. There are two metrics that quantify the quality 
of the paths returned by a routing algorithm: the congestion C, which is the maximum number 
of paths that use any edge in the network, and the maximum path length D. Assuming there 
is a packet for each path, a lower bound on the delivery time of the packets is 0(max(C, D)) 
(alternatively, f2(C + D)). Actually, there exist packet scheduling algorithms that given the paths, 
they deliver the packets along the paths in time close to optimal 0(max(C, D)) (alternatively, 
0{C + D)) [?, ?, ?, ?, ?]. 

Motivated by the selfish behavior of entities in communication networks, we study routing games 
where each packet's path is controlled independently by a selfish player. We model games with N 
players, where each player has to select a path from a source to a destination node. The objective of 
each player i is to select a path that simultaneously minimizes two parameters: the congestion Ci, 
which is the maximum number of paths that use any edge in player i's path, and the path length 
Di. We examine two kinds of games: max games, where the player's cost function is max(Ci,L>j), 
and sum games, where the player's cost function is C\ + Di. In each of these games, the player's 
objective is to selfishly minimize its cost in an uncoordinated manner. From the player's point of 
view, the minimization of the sum or max cost functions are justified objectives, since it is shown 
in [?] that player i's packet can be delivered in time 0(Ci + Di) (alternatively, 0(max(Cj, Di)). 

A natural problem is to determine the effect of the players' selfishness on the welfare of the whole 
communication network. In the max and sum games, the welfare of the network is measured with 
the social cost functions max(C, D) and C+D, respectively. The choice of these social cost functions 
is appropriate since they determine the total time needed to deliver the packets represented by the 
players. We examine the consequence of the selfish behavior in Nash equilibria, which are stable 
states of the game where no player can unilaterally improve her situation. The effect of selfishness 
is quantified with the price of anarchy (PoA) [?, ?], which expresses how much larger is the worst 
social cost in a Nash equilibrium compared to the social cost in the optimal coordinated solution. 
We study the existence of Nash equilibria and the price of anarchy for max games and sum games, 
where we find that these games produce different results with their own merits. 

1.1 Max Games 

First, we examine max games (the social cost is max(C + D)). We prove that every max game has 
at least one Nash equilibrium. The equilibrium can be obtained by best response dynamics, where 
a player greedily changes, whenever possible, the current path to an alternative path with lower 
cost. With best response moves the game eventually converges to a Nash-equilibrium. We show 
that the optimal coordinated solution is a Nash-equilibrium too. Thus, max games games have very 
good Nash equilibria. This observation is quantified in terms of the price of stability (PoS) [?, ?] 
which expresses how much larger is the best social cost in a Nash equilibrium with respect to the 
social cost in the optimal coordinated solution. Therefore in max games it holds that PoS = 1. 

We then examine the worst Nash equilibria. We bound the price of anarchy (PoA) in max 
games with respect to the maximum allowable path length L for the players in the network, and 
the number of nodes n in the graph: 

PoA = 0(L + log n). 
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We prove that this bound is worst case optimal (within additive terms). Specifically, we provide 
an example game in a ring network where the optimal coordinated social cost is 1, while there is a 
Nash equilibrium with cost O(L) = 0(n). 

1.2 Sum Games 

We continue with examining sum games (the social cost is C + D). Intuitively, sum games have the 
potential to give better price of anarchy than the max games because both parameters (C and D) 
affect the choices at all the time, even when one parameter is larger than the other. For example, 
the ring game that we mentioned above has price of anarchy equal to 1 in the sum game. However, 
we prove a limitation of sum games: not all sum games have Nash equilibria; there exist instances of 
sum games with a small number of players that do not have Nash equilibria at all. This limitation 
directed us towards exploring alternative games which are stable (have Nash equilibria) and have 
similar characteristics with the original sum games. 

We found such a game variation that we call sum-bucket game. In sum-bucket games the players 
are divided into log n classes, called buckets, according to the packet paths that they choose. Bucket 
k holds the paths of players with length in range [2 k , 2 k ~ 1 ). Suppose that player i's path is in bucket 
k. The normalized congestion of player i, denoted Cj, is measured with respect to the paths that 
belong to bucket k. The normalized length of player i's path is Di = 2 k ~ l — 1, (which is a factor 
2 approximation of the original length). Player i's cost function is Cj + Di. Thus, in sum-bucket 
games only players in the same bucket compete with each other, while players in different buckets do 
not interfere. The normalized social cost function is defined to be C + D, where C is the maximum 
normalized congestion in any bucket, and D is the maximum normalized depth of all paths. 

We first show that sum-bucket games always have Nash equilibria, which can be obtained with 
best response dynamics. We then examine the quality of the Nash equilibria. For every game 
there is a corresponding coordinated bucket routing problem. We can bound the price of anarchy 
PoA with respect to the normalized optimal congestion C and normalized path length D in the 
optimal coordinated solution. We obtain: 

( C* D* \ 
PoA = Oi , -log 2 raj 

Therefore, when either of C* or D* is small (e.g. a constant), the Nash equilibrium provides a very 
good approximation (within a poly-log factor from optimal) to the uncoordinated routing problem. 
In such scenarios, the price of selfishness is small. However, when both C or D are simultaneously 
large, the approximation becomes worse (though still typically lower than the PoA of the max game 
since the PoA is bounded by the smaller of C or D , where D < 2L). Nevertheless, even in these 
scenarios the PoA bound is tight in certain games instances. 

Sum-bucket games are interesting variations of sum games because they are stable, and they 
can be used to approximate solutions for the C + D social cost. For any sum-bucket game, there 
is a corresponding "original" coordinated routing problem where the objective is to minimize the 
social cost C + D without using buckets. It holds that C < C < C • logra and D < D < 2D; 
thus, C + D = 0(C • logra + D). In other words, the normalized social cost can be used as 
an approximation for the "original" social cost. Let PoA' denote how much larger is the worst 
equilibrium of a sum-bucket game compared to the optimal solution of the coordinated original 
problem (with respect to the social cost C + D). It holds that PoA' < PoA ■ logra. Consequently, 
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the observations that we made above for the PoA in sum-bucket games apply also with respect to 
the original routing problem. For example, when one of C* or D* is small (e.g. a constant), then 
the Nash equilibrium of the sum-bucket game provides a very good approximation (within a poly 
log factor from optimal) to the coordinated original routing problem. 

1.3 Related Work 

Routing games (on congestion) were introduced and studied in [?, ?]. The notion of price of 
anarchy was introduced in [?]. Since then, many routing game models have been studied which are 
distinguished by the topology of the network, cost functions, type of traffic (atomic or splittable), 
nature of strategy sets, and kind of equilibria (pure or mixed). Specifically, pure equilibria with 
atomic flow have been studied in [?, ?, ?, ?, ?] (our work fits into this category), and with splittable 
flow in [?, ?, ?, ?]. Mixed equilibria with atomic flow have been studied in [?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?], and with splittable flow in [?, ?]. 

To our knowledge there is no previous work that considers routing games that optimize two 
criteria simultaneously. Most of the work in the literature uses a single cost metric which is related 
to the congestion. A common metric for the player cost is the sum of the congestions on all the 
edges of the player's path (we denote this kind of player cost as pc') and the respective social cost 
is the cost of the worst player's path (we denote this social cost as SC) [?, ?, ?, ?, ?, ?]. However, 
as we discussed before, in packet scheduling algorithms, the pc' or SC' do not govern the packet 
delays; max(Cj, Di) or Gi + Di govern the packet delay. 

Other combinations of player costs and social costs have been studied in the literature: player 
cost pc 1 and social cost C has been studied in [?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?]; player cost Cj and 
social cost C has been studied in [?]; other variations have been studied in [?, ?, ?, ?]. The vast 
majority of the work on routing games has been performed for parallel link networks, with only a 
few exceptions on general network topologies [?, ?, ?, ?]. 

Our work is closer to [?]. We extended some results presented in [?] to apply to bicriteria, 
instead of the single criterium of congestion, player cost Cj and social cost C, that was used 
in [?] . Specifically, the particular techniques that we use to prove existence of Nash equilibria with 
best response dynamics, and also to prove upper bounds on the price of anarchy, were originally 
introduced in [?]. Here, we modified and extended appropriately these techniques in a non-trivial 
way to apply to our new cost functions. 

Outline of Paper 

We proceed as follows. In Section [2] we give basic definitions. We study max games in Section [3] 
and sum games in Section 01 We finish with our conclusions in Section [5j Due to space limitations 
some proofs have moved to the appendix. 

2 Definitions 

An instance of a routing game is a tuple 1Z = (N, G,V), where N = {1, 2, . . . , N} are the players, 
G = (V,E) is a graph with nodes V and edges E, and the graph has paths V = UieN^> where 
Vi is a collection of available paths in G for player i. Each path in Vi is a path in G that has the 
same source u\ € V and destination V{ G V; each path in Vi is a pure strategy available to player 
i. A pure strategy profile p = [pi,P2> • • ■ >Pn] is a collection of pure strategies (paths), one for each 
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player, where pi € Vi- We refer to a pure strategy profile as a routing. On a finite network, a 
routing game is necessarily a finite game. 

For any routing p and any edge e £ E, the edge- congestion C e (p) is the number of paths in 
p that use edge e. For any path p, the path- congestion C p (p) is the maximum edge congestion 
over all edges in p, C p (p) = max eep C e (p). We will use the notation Cj(p) = C Pi (p), for any 
user i. The network congestion is the maximum edge-congestion over all edges in E, that is, 
C(p) = max e gE C e (p). We denote the length (number of edges) of any path p as For any user 
i, we will also use the notation D Pi (p) or Di(p) to denote the length \pi\. The longest path length 
in V is denoted L(V) = max pe p \p\. We will denote by D (p) the maximum path length in routing 
p, that is -D(p) = maxpgp \p\. When the context is clear, we will drop the dependence on p and 1Z 
and use the notation C e , C p , Ci, C, L, D p , Di,D. 

For game R and routing p, the social cost (or global cost) is a function of routing p, and it 
is denoted SC(p). The player or local cost is also a function on p denoted pcj(p). We use the 
standard notation p_j to refer to the collection of paths {p±, ■ ■ ■ ,pi-±,pi+i, ■ ■ ■ ,pn}, and (pf,p-i) 
as an alternative notation for p which emphasizes the dependence on pi. Player i is locally optimal 
in routing p if pcj(p) < pcj(p-;p_j) for all paths p\ € Vi- A routing p is in a Nash Equilibrium 
(we say p is a Nash-routing) if every player is locally optimal. Nash-routings quantify the notion 
of a stable selfish outcome. A routing p* is an optimal pure strategy profile if it has minimum 
attainable social cost: for any other pure strategy profile p, SC(p*) < SC(p). 

We quantify the quality of the Nash-routings by the price of anarchy (PoA) (sometimes referred 
to as the coordination ratio) and the price of stability (PoS) . Let P denote the set of distinct Nash- 
routings, and let SC* denote the social cost of an optimal routing p*. Then, 

PoS = mf „1 ' , PoA= sup „1 . 
P e p SC* ' pe p SC* 



3 Max Games 

Let 1Z = (N, G,V) a routing game such that for any routing p the social cost function is SC(p) = 
max(C(p), -D(p)), and the player cost function pcj(p) = max(Cj(p), -Dj(p)). We refer to such 
routing games as max games. First, we show that max games have Nash-routings and the price of 
stability is 1. Then, we bound the price of anarchy. 



3.1 Existence of Nash-routings in Max Games 

We show that max games have Nash-routings. We prove this result by first giving a totaly order 
for the routings using a form of lexicographic ordering. Then we show that any greedy move of 
a player can only give a new routing with smaller order. Thus, the greedy moves will converge 
either to the smallest routing or to a routing where no player can improve further. In either case, 
a Nash-routing will be reached. 

Let TZ = (N, G, V) be a max routing game. Let r = max(iV, L). For any routing p we define the 
routing vector M(p) = [mi(p), . . . ,m r (p)], where mj(p) = a^(p) + 6j(p), and ctj(p) is the number 
of paths with congestion i, and h(p) is the number of paths with length i. Note that if SC{p) = k 
then / and m' k = for all kl > k. 

We define a total order on the routings as follows. Let p and p' be two routings, with M(p) = 
[mi, . . . , m r ], and M(p') = [m^, . . . , m' r ]. We say that M(p) = M(p') if mi = m\ for all 1 < i < r. 
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We say that M(p) < M(p') if there is a j, 1 < j < r, such that m^ = m' k for all A; > j, and 
mj < m^-. We order the p and p' according to the order of their respective vectors, that is p < p' 
if and only if M(p) < M{p'). Note that for any two p and p' it either holds that p = p' or p < p' . 
That is, the routings are totally ordered. 

Consider an arbitrary routing p. If p is not a Nash-routing, there is at least one user i which 
is not locally optimal. Then a greedy move is available to player i in which the player can obtain 
lower cost by changing the path from pi to some other path p\ with lower cost. In other words, 
the greedy move takes the original routing p = (pf, p_j) to a routing p' = {p[; p'_J with improved 
player cost pci{p') < pq(p), such that pi is replaced by p\ and the remaining paths stay the same 
(p_i = p'_j). We show now that any greedy move gives a smaller order routing: 

Lemma 3.1 If a greedy move by any player takes a routing p to a new routing p' , then p' < p. 

Proof: Let pa(p) = max(C i (p), A(p)) = ^f ax , and min(Q(p), A(p)) = kf n (clearly, /cf ax > 
kf in ). Let also pej(p') = max(C i (p / ), A(p')) = fc f ax , an d min(C i (p') 1 A(p')) = k f n (clearly, 
^.max y &™ m ). Since player i can decrease its cost in p', A;™ ax < fcf 1 ^. Consider now the vectors 
M(p) = [mi, . . . , m r ] and M(p') = [m' x , . . . , mj,]. These two vectors are the same except possibly 
for entries fc™ 8 "*, fc™ m , £;™ ax , /c™ m , which correspond to the positions that are affected by paths p, 
and j^. It holds that m^max > m^. max , since when the path switches to p^, = a^p + fe^max 

decreases by at least one because either a^max decreases by one (if the new path has lower congestion) 
or frfcmax decreases by one (if the new path has lower length). Since fc™ ax < kf 13 *, M(p) > M(p') 
implying that p > p'. ■ 

Since there are only a finite number of routings, Lemma [3.11 implies that starting from arbitrary 
initial state, every best response dynamic converges in a finite time to a Nash-routing, where every 
player is locally optimal. Since the routings are totally ordered, there is a routing p m i n which is 
the minimum, that is, for all routings p, p m i n < p. Clearly, the minimum routing is also a Nash- 
routing. The minimum routing p m i n achieves also optimal social cost, since if there was another 
routing p' with lower social cost, then it can be easily shown that p' < p m i n , which is contradiction. 
Thus, the price of stability is 1. Therefore, we have the following result: 

Theorem 3.2 (Stability of max games) For any max game 1Z, every best response dynamic 
converges to a Nash-routing, and the price of stability is PoS = 1. 

3.2 Price of Anarchy in Max Games 

We bound the price of anarchy in max games. Consider a max routing game 1Z = (N, G, V), where 
G has n nodes. Theorem 13.21 implies that there is at least one Nash-routing. Consider a Nash- 
routing p. Denote C = C(p) and D = D(jp). Let p* be the optimum (coordinated) routing with 
minimum social cost. Denote C* = C(p*) and D* = D(p*). Note that each payer i£N has a path 
Pi S p and a corresponding "optimal" path p* £ p* from the player's source to the destination. 

For each edge e S G, denote II e (p) the set of players whose paths in routing p use edge e. We 
define H to be a set that contains all edges e £ G with congestion C e (p) > D + 2. Consider an 
edge e £ H. Let i £ II e (p) be a player whose path pi in routing p uses edge e. We define /(e, i) 
to be a set that contains all edges e' E p* with C e i{p) > C e (p) — 1. It holds that |/(e, i)\ > 1, 
since in routing p player i prefers path pi instead of p* because there is at least one edge e' £ p* 
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with C e /(p) > C e (p) — 1 > D. Let /(e) = U ign (p)/( e iO- For any set of edges X C H, we define 
/(X) = U ee x/(e)- 



Lemma 3.3 Lei Z 6e £/ie set that contains all edges e with congestion C e (p) > C — 21ogn. // 
C > D + 2\gn + 2, then there is a set of edges XCZ such that \ f(X)\ < 2\X\. 

Proof: We recursively construct a sets of edges E , . . . ,E 2 \ gn , such that E^ = U 
and set Eq contains all the edges e with congestion C e (p) = C . Prom the construction of those 
sets it holds that for any e 6 Ej, C e (p) > C — j, where < j < 21gn. Thus, Ej C Z, for all 
< j < 21gn. (Note that Z C F.) 

We can show that there is a j, < j < 21gn, such that |/(£j)| < 2|£j|. Suppose for contra- 
diction that such a j does not exist. Thus for all j, < j < 21gn, it holds that \f(Ej)\ > 2\Ej\. In 
this case, it it straightforward to show that \E^\ > 2\Ek-i\, for any 1 < k < 21gn. Since |-Eo| ^ L, 
it holds that |i?2ign| > 2 21gn = n 2 . However, this is a contradiction, since the number of edges in 
G do not exceed n 2 . ■ 



Lemma 3.4 // C > D + 2 lg n + 2, then C < 2LC* + 21gn. 

Proof: From Lemma 13.31 there is a set of edges X C Z with < 2\X\. For each e G Z it 

holds that C e (p) > C - 21gn. Let M = J] eeX C e (p) > |X|(C - 21gn), where M denotes the total 
utilization of the edges in X by the paths of the players in IL Let II = IJeex n e (p)> that is, LT is 
the set of players which in routing p their paths use edges in X. By construction, the congestion 
in routing p in each of the edges of X is caused only by the players in LT. Since path lengths are 
at most L, each player in LT can use at most L edges in X. Hence, M < L ■ \H\. Consequently, 
\X\(C- 21gn) < L • |n|, which gives: C < (L ■ |n|)/|X| +21gn. 

By the definition of f(X), in the optimal routing p* each user in n has to use at least one 
edge in f(X). Thus, edges in the optimal routing p*, the edges in f(X) are used at least n times. 
Thus, there is some edge e E f{X) with C e (p*) > |n|/|/pQ|. Therefore, C* > |n|/|/(X)|. Since 
|/(X)| < 2|X|, we obtain |H| < 2C* ■ \X\. Therefore: C < 2LC* + 21gn. ■ 

Theorem 3.5 (Price of anarchy in max games) For any max game 1Z it holds that PoA = 
0(L + logn). 

Proof: Suppose that p is the worst Nash-routing with maximum social cost. We have 
PoA = SC{p)/SC{p*). If C > D + 21gn + 2, then SC(p) = C. From Theorem E31 
PoA < C/max(C*,L>*) < (2LC* + 21gn)/C* < 2L + 21gn. If C < D + 21gn + 2, then 
SC (p) < D + 21gn + 2; thus PoA < L + 21gn + 2. Hence, in both cases PoA = 0(L + logn). ■ 

There is a max game that shows that the result of Theorem 13.51 is tight in the worst case. 
Consider a ring network with n nodes and n edges. Give the same orientation to the edges, so that 
each edge has one left node and one right node. For each edge ej, there is a corresponding player i 
whose source is the left node and the destination is the right node of the edge. The strategy set of 
each player has two paths: path pi which is only the edge e^, and path which goes around the ring. 
Note that p = [pi,P2> • • ■ ,Pn] is a Nash-routing with social cost 1. However, p' = [pi,P2> • • ■ ,Pn] is 
also a Nash routing with social cost n — 1. Thus, the price of anarchy is O(n) = O(L). 
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4 Sum Games 



Let R = (N, G, V) be a routing game such that for any routing p the social cost function is 
SC(p) = C(p) + D(p), and the player cost function pCj(p) = Cj(p) + A(p)- We refer to such 
routing games as sum games. We first show that such games have instances without Nash-routings. 
Then we describe a variation of sum games, that we call sum-bucket games, which are stable and 
their equilibria have good properties. 

4.1 A Sum Game without Nash-routings 

Theorem 4.1 There is sum game instance TZ = (N,G,V) that has no Nash-routing. 

Proof: The graph G is depicted in the figure below. There are seven players, namely, N = 
{1,...,7}. Players 1, 2, and 3, have respective strategy sets V\ = {pi,p[}, V2 = {P2,P2}> and 
Vz = {p3,P3j-- In the figure for player i = 1, . . . , 3 the respective source and destination nodes are 
Ui and Vi. There are six critical edges denoted ei, . . . , e% that the paths use and which are shown in 
the figure as straight horizontal lines. These edges may have congestion larger than 1. The squiggly 
part of the paths are assumed to have congestion 1 and their length and their lengths are chosen 
so that the following relations hold: \p[\ = \pi \ — 2, \p' 2 \ = \p2 \ + 3, and \p' 3 \ = \ps\ + 3. 



Players 4 to 7 are "passive" in the sense that they have only one path in their strategy sets, 
and their sole purpose is to create additional congestion on edges e3,e4,es,e6 (the paths of these 
players are not shown explicitly in the figure). In particular, the passive players cause additional 
congestion 1 to edge additional congestion 3 to e^ and e$, and additional congestion 4 to e%. 
The additional congestion is depicted in the figure inside a parenthesis under each edge. 

Since the only "active" players are 1, 2, and 3, and each player has two path choices, there are 
eight possible different routings. We examine each routing and prove that it is not a Nash-routing. 
We use the vector \pi,P2,P3] to denote a routing where the ith position of the vector contains the 
path choice of user i. By setting explicit values to the path lengths, and computing the player costs 
in each routing, we find that: player 1 is not locally optimal in routings \pi,P2,P3] and [p'liP^iPzYi 
player 2 is not locally optimal in routings [pi , P2 , P3] , [pijP^Pjs]) [Pi>P2>P3], and [pi , p 2 , P 3 ] 5 and 
player 3 is not locally optimal in routings [p'nP^iPz] and \p\,P2,p'^[- ■ 

4.2 Sum-bucket Games 

Here we describe sum-bucket games, which are variation of sum games that are stable and their 
equilibria have good properties. Let TZ = (N, G,V) denote a sum-bucket routing game. The paths 




e 4 (+3)"e 5 (+3) w e 6 (+4)' 
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in V are divided into buckets Bq, . . . , B\ g i so that Bk is a set that contains all paths whose lengths 
are in range [2 fc ,2 fc+1 ). (We use IgL instead of |~lg£] to avoid notational clutter.) For any path 
p G V, let B(p) denote the index of the bucket that p belongs to; namely, if p G B^, then B(p) = k. 

Consider now a routing p. We define the normalized length of path p G p as D p (p) = 2 B ^ +1 — 1 
(which is the maximum possible path length in bucket B(p)). Note that all the paths in the same 
bucket have the same normalized length. For any path p we define the normalized congestion C p (p) 
to be the maximum congestion on any of the edges of path p which is caused by the paths of routing 
p which belong to bucket B(p). 

Player i's cost is pci(p) = Cj(p) + Dj(p). The player is allowed to switch from one bucket to 
another. The normalized congestion of p is C(p) = max PiGp Cj(p), and the normalized length of 
p is D(p) = maxp. g p -Dj(p). The social cost of game 7Z is SC(p) = C(p) + D(p). Below, we show 
that sum-bucket games are stable and then we bound the price of anarchy 

4.2.1 Existence of Nash-routings in Sum-bucket Games 

Here we show that sum-bucket games have Nash-routings. We use the same technique as in Sec- 
tion [3J3 where we order the routings and prove that greedy moves give smaller order routings. Let 
1Z = (N, G,V) be a sum-bucket routing game. Let r = N + 2L — 1 (this is the maximum possible 
player cost). For any routing p we define the routing vector M(p) = [mi(p), . . . , m r (p)] such that 
mj(p) is the number of paths in p with cost j. We define a total order on the routings, with respect 
to their vectors, in exactly the same way as wee did for the max games in Section \3. 11 Using similar 
techniques as in the max games, we can prove that if a greedy move by player i takes a routing 
p to a new routing p', then p' < p. Since there are only a finite number of routings, every best 
response dynamic converges in a finite time to a Nash-routing. Therefore, we get: 

Theorem 4.2 (Stability of sum-bucket games) For any sum-bucket game 1Z, every best re- 
sponse dynamic converges to a Nash-routing. 

4.2.2 Price of Anarchy in Sum-bucket Games 

From Theorem l4.2l every sum-bucket game has at least one Nash-routing. Here, we bound the price 
of anarchy. Consider a sum-bucket routing game 7Z = (N, GjV), where G has n nodes. Consider a 
Nash-routing p. Denote C = C(p) and D = D(p). Let p* be the optimum (coordinated) routing 
with minimum social cost. Denote C = C(p*) and D = D(p*). Note that each payer i G N 
has a path in p, G p and a corresponding "optimal" path p* G p* from the player's source to the 
destination node. For any player i, let Si denote the shortest path in V which connects the source 
and destinations nodes of %. We now relate the paths lengths with the congestion: 

Lemma 4.3 In Nash-routing p, for any player i with Ci > C — x, where x > 0, it holds that 
\Pi\ < \si\ + x + 1. 

Proof: Suppose for the sake of contradiction that there is a player i with \pi\ > \si\ + x + 1. 
Then, pa = Ci + Di > C - x + A > C - x + \pi\ >C-x + |s»| + x + 1 = C + \si\ + 1. Clearly, 
\si\ < 2 B ( S ^ +1 — 1. If user i was to switch to path s« its cost would be pc[ < C + 1 + 2 B ^ +l — 1, 
since the normalized length of Sj is 2 B ( Si ^ +1 — 1, and Sj has normalized congestion at most C before 
player % switches, and the normalized congestion of path Sj increases to at most C + 1 after player i 
switches to it. Therefore, pc- < C + 1 + |sj| < pcj. Thus, in p player i would not be optimal, which 
is a contradiction, since p is a Nash-routing. Therefore, \pi\ < \si\ + x + 1, as needed. ■ 
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For each edge e G G let II e (p) denote the set of players whose paths in routing p use edge 
e. Let C ejPi (p) denote the number of packets that use edge e in p and are in the same bucket 
as pi. Let C e (p) = max Pi C etPi (p) denote the normalized congestion of edge e. For any edge e, 
we define f(e,i) to be a set that contains all edges e' G p* with C e /, P *(p) > C ejPi (p) — D . Let 
/(e) = Uj S n e ( p )/(e, i), and for any set of edges X, f(X) = U e gx/( e )- ^ can ^ e snown that in 
Nash-routing p it holds \ f(e,i)\ > 1. 

Lemma 4.4 Lei Z be the set that contains all edges e with congestion C e (p) > C — 2D* -lgn. 
There is a set of edges IC2 with \f(X)\ < 2|X|. 

Proof: We recursively construct a sets of edges Eq, . . . , -S^igm such that Ei = E{-\ U f(E^i), 
and set Eq contains all the edges e with congestion C e (p) = C. We can show that there is a j, 
< j < 2 lgn, such that \f(Ej)\ < 2\Ej\. Suppose for contradiction that such a j does not exist. 
Thus for all j, < j < 2 lgn, it holds that > 2|£^|. In this case, it it straightforward to 

show that \E k \ > 2\E k _ 1 \, for any 1 < k < 2 lgn. Since \E Q \ > 1, it holds that \E 2 \ sn \ > 2 21 § n = n 2 . 
However, this is a contradiction, since the number of edges in G cannot exceed n 2 . Thus, there is 
a j with \f(Ej)\ > 2\Ej\. We will set X = Ej. 

It only remains to show that X <Z Z. It suffices to show that for any E k and e £ E k , C e (p) > 
C -kD , where < k < 2 lgn. We prove this by induction on k. For fc = we have that every 
edge in e has C e (p) = C = C — • D , thus the claim trivially holds. For the induction hypothesis, 
suppose that the claim holds for any k = t < 2 log n. In the induction step we will prove that the 
claim holds also for k = t + 1. We have that Et+i = Et U f(Et)- By induction hypothesis, for any 
e G E t , C e (p) > C-tD* (thus, for any e €_fit it holds that C e (p) > C - (t + l)D*)). Thus, for any 
e G £fc there is at least one path with C e . Pi (p) > C — tD . By definition of f(e,i), every edge 
e G /(e, i) has the property that C e ', P * (p) > Ce,p, (p) — -D > C — (t + 1)D . Thus, there is at least 
one path p' £ p which is in the same bucket with p* (namely, B(p') = B(p*)) for which it holds 
that C e /y(p) = C e ' iP *(p). Therefore, C e '(p) > C — (t + 1)D . Consequently, from the definition of 
f{E t ) it follows that for any edge e' G /(-Bt) it holds that C e /(p) > C — (t + By considering 

the union of Et U f(Et), we have that the claim holds for any edge in e G -Et+i, as needed. ■ 

Lemma 4.5 /n Nash-routing p it ZioWs £/iat C < 18C* • • lg 2 n. 

Proof: From Lemma 14.41 there is a set of edges X C Z with |/(X)| < 2\X\. For each e £ Z it 
holds that C e (p) > C — 2D • lgn. Let II = IJeex n e (p)> that is, II is the set of players which in 
routing p their paths use edges in X. Let M = J2 e ex ^e(p), which denotes the total "normalized" 
utilization of the edges in X. We have that M > \X\(C — 2D* ■ lgn). 

By construction, the congestion in routing p in each of the edges of X is caused only by the 
players in II. We can bound the path lengths of the players in II with respect to D as follows. 
Consider a player i G II. We have that Cj(p) > C — 2D* ■ lgn. From Lemma [4731 and the fact that 
\si\ < D*, we obtain: \pi\ < |sj| + 2D* ■ lgn + 1 < D* + 2D* ■ lgn + 1 < AD* ■ lgn. Thus, the path 
length of every player in II is at most K = AD • lg n. 

M can also be bounded as M < K\Ii\. Consequently, |X|(C — 2D Tgn) < .K"|n|, which gives: 

C < m + 2D* ■ lgn = AW ■ |n| + 2D* ■ lgn. (1) 

I I I I 

Since |/(e, i)\ > 1, in the optimal routing p* the path of each user in II has to use at least one edge 
in f(X). Thus, in the optimal routing p*, the edges in f(X) are used at least |II| times. Thus, there 
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is some edge e G f(X) which in p* is used by at least |II|/|/(X)| paths. Since there are IgL + 1 
buckets, the normalized congestion of e in one of those buckets is at least |n|/(|/(X)| • (IgL + 1)). 
Therefore, C* > |II|/(|/(X)| • (IgL + 1)). Since |/(X)| < 2\X\, we obtain: 

|n| < 2C* ■ \X\ • (IgL + l) < AC* ■ \X\ -lgn. (2) 

By Combining Equations □ and El we get: C < 16C* • D* ■ lg 2 n + 2D* lg n < 18C* • D* ■ lg 2 n. ■ 

When C > D/4, using Lemma 14.51 it is straightforward to prove that PoA = 
0((C* ■ D* ■ lg 2 n) /(C* + IT)). If C < D/4, then using LemmaH31 we can prove that PoA = 0(1) 
(the details can be found in the appendix). Therefore, we obtain the main result: 

Theorem 4.6 (Price of anarchy in sum-bucket games) For any sum-bucket game 1Z it 
holds: 

I ' c* .75* \ 
PoA = O =j — =f ■ lg 2 n . 

\C +D J 

There is a sum-bucket game 1Z = (N, G, V) that shows that the result of Theorem l4.6l is tight in 
non-trivial cases. All the players have the same source node u and destination node v. Let a = s/N 
(suppose for simplicity that a = y/~N = \y/N ] ) . There is a path p of length a from u to v. There are 
a edge-disjoint paths Q = {q\, . . . , q a } from u to v so that each path % has length a and uses one 
edge of p. Each player has two paths in her strategy set: one is path p and the other is a path from 
Q. Further, for each path there are a players that have % in their strategy sets. Let p be the 
routing where every player chooses path p. Then, p is a N ash-routing with social cost a + N. Let p' 
be the routing where every player chooses the alternative path in Q. Then, p' is also a Nash-routing 
with social cost 2a. Thus, PoA > SC(p')/SC(p) > (a + N)/(a + 1) = Q{y/N) = Q(y/n). Routing 
p' is an optimum routing with the smallest social cost C = C(p) = a and D = D(p) = a. Thus, 
from Theorem EES! PoA = 0((C* ■ D* ■ lg 2 n)/(C* + 25*)) = 0(a ■ lg 2 n) = 0(^/E ■ log 2 n). Hence, 
the price of anarchy has to be within a log 2 n factor from the bound provided in Theorem 14.61 

5 Conclusions 

In this work we provided the first study (to our knowledge) of bicriteria routing games, where the 
players attempt to simultaneously optimize two parameters: their path congestion and length. The 
motivation is the existence of efficient packet scheduling algorithms which deliver the packets in 
time proportional to the social cost. We examined max games and sum games. Max games stabilize, 
but their price of anarchy is high. Sum games do not stabilize, but they can give better price of 
anarchy. We then give the approximate sum-bucket game which always stabilizes and preserve the 
good properties of sum games. Surprisingly, arbitrary sum-bucket game equilibria provide good 
approximations to the original coordinated routing problem. 

Several open problems remain to examine. We studied two particular functions of the bicriteria, 
namely, the max and the sum functions. There are other functions, for example a weighted sum, that 
could provide similar or better results. It would also be interesting to add additional parameters. 
The original C + D sum games do not stabilize in general. However, there exist interesting instances 
which stabilize. For example, it can be easily shown that the games where the available paths have 
equal lengths always stabilize. It would be interesting to find a general characterization of the 
game instances that stabilize. Another interesting problem is to provide time efficient algorithms 
for finding equilibria in our games. 
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A Additional Proofs of Section 13.11 



Lemma A.l Minimum routing p m i n achieves optimal social cost, that is, SC(p m m) < SC(p), for 
any other routing p 7^ p m i n . 

Proof: Suppose for contradiction that there exists a routing p > p m i n with SC(p) < 5C(p m i n ). 
Let SC(p) = max(C(p),D(p)) = h, and 5C(p min ) = max(C(p min ), L»(p min )) = k 2 . Clearly, 
k% < k 2 . Therefore, in the vector M(p) = [mi, . . . ,m r ] it holds that 7^ and m& = for 
k > k\. Similarly, in the vector M(p m i n ) = [rhi, . . . ,rh r ] it holds that fhk 2 7^ and fhk = for 
k > k 2 . Therefore, M(p m ; n ) > M(p), contradicting the fact that p > p m i n - ■ 

B Additional Proofs of Section 14.11 

In the table below we calculate the congestions, path lengths, and player costs for each routing 
scenario of the game in Theorem 14.11 We set the specific lengths as: \pi\ = 10, \pi\ = 8, |je>2 | = 
7, \p' 2 \ = 10, |jp3 1 = 7, and \p' 3 \ = 10. For a player i £ {1,2,3} and routing p we define the 
complementary routing to be the one where player i chooses the alternative path. For example, 
for player 2 the complementary routing of [p\ , p 2 , P3] is \p% , p' 2 ,pz[. A player is locally optimal in a 
routing if the complementary routing does not give a lower cost for the player. Using the table it 
is easy to determine whether a player is locally optimal or not by examining the respective costs in 
the complementary routings. In this way, we find the non-locally players which are shown in the 
rightmost column of the table. 



routing 


Ci 


Di 


PCl 


c 2 


D 2 


pc 2 


c 3 


^3 


PC3 


Non locally optimal players 


[Pl,P2,P3] 


4 


10 


14 


4 


7 


11 


4 


7 


11 


player 1 




5 


8 


13 


5 


7 


12 


5 


7 


12 


player 2 


Ip'vP^Ps] 


5 


8 


13 


1 


10 


11 


5 


7 


12 


player 3 


IPvPz'P'sl 


5 


8 


13 


1 


10 


11 


1 


10 


11 


player 1 


\PUP2,Pz] 


2 


10 


12 


2 


10 


12 


2 


10 


12 


player 2 




3 


10 


13 


4 


7 


11 


2 


10 


12 


player 3 


\pl,p' 2 :ps] 


3 


10 


13 


2 


10 


12 


4 


7 


11 


player 2 


[P[,P2,P' 3 ] 


5 


8 


13 


5 


7 


12 


1 


10 


11 


player 2 



C Additional Proofs of Section 14.2.11 

Lemma C.l If a greedy move by player i takes a routing p to a new routing p' , then p' < p. 

Proof: Let p, t and p\ denote the paths of % in routings p and p', respectively. Let pcj(p) = 
Cj(p) + Di(p) = zi and pcj(p') = Cj(p') + -Dj(p') = z 2 . Since player i decreases its cost in p', 
z 2 < Z\. Consider now the vectors of the routings M(p) = [mi, . . . , m r ] and M(p') = [m^, . . . , m' r ]. 
We will show that M(p) < M(p'). 

Let B(pi) = k\ and B(p' i ) = k 2 . Let V denote the set of players whose cost increases in p' with 
respect to their cost in p. Next, we show that for any j G V it holds that pcj(p') < Cj(p'), which 
will help us to prove the desired result. 

Let pj be the path of j £ V. Let B(pj) = k% (note that j does not switch paths and buckets 
between p and p'). If k^ ^ k\ and k% ^ k 2 then the cost of j remains unaffected between p and 
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p'. Thus, either k% = k\ or k% = ki- If k^ = k%, then the cost of j can only decrease from p to 
p', since path pi can no longer affect path pj. Therefore, it has to be that k% = k?- Suppose, for 
the sake of contradiction, that pcj(p') > pcj(p'). Then, Cj(p') + Dj(p') > Cj(p') + A(p')- Since 
both paths are in the same bucket, Dj(p') = A(p')> which implies that Cj(p') > Ci(p'). Since 
j £ V, Cj(p) < Cj(p'). The increase in normalized congestion of pj in p' can only be caused by 
p\ because it shares an edge with pj with congestion Cj(p'). However, this is impossible since it 
would imply that Cj(p') > Cj(p'). Therefore, pcj(p') < pcj(p'). 

Consequently, in vector p' all the entries in positions j% + 1, • • • , r do not increase with respect 
to p. Further, because i switches paths, > m^. Thus, M(p) < M(p'), as needed. ■ 

D Additional Proofs of Section 14^21 

Lemma D.l In Nash-routing p, for every player i and edge e it holds that |/(e, i)\ > 1. 

Proof: Suppose that |/(e, i)\ =0. Then for every edge e' £ p* it holds that C e ' iP *(p) < C e)Pi (p) — 

D . Let C — max e ' e p* C e ' : p* (p). If player i was to choose path p* its cost would be: pc'^ < 

C' + 1 + D p * < C e>p .(p)-D* + 1 + D* = C e>p .(p) + 1 < Ci(p) + A(p) =pc l (p). Thus, pc / l < p Ci (p) 
which implies that player i is not locally optimal in Nash-routing p, a contradiction. ■ 

Proof of Theorem I4.6t 

Suppose that p is the worst Nash-routing with maximum social cost. We have that PoA < 
SC(p)/SC(p*) < (C + D)/(C* + D*). We examine two cases: 

• C > D/4: In this case D = 0(C). From Lemma ELTH C < 18C* ■ D* ■ lg 2 n. Therefore: 
PoA = 0(C/(C* + D*)) = O((0* ■ D* ■ lg 2 n)/(C* + D*)). 

• C < D/A: Let pi G p be the path with maximum cost in p. Clearly, pcj(p) = Cj + Di > 
~D. Further^ £_(7i(p) < C < D/A. Thus, A ^ D -Ci > D_-D/A = 3D /A. Since 
Ci > = C - C, Lemma K2\ gives \pi\ < \si\ + C + l<D* + D/A + 1. We have that 
D_i/2 <_\pi\. Therefore, A/2 < D* + D/A + 1, which gives: 3D/_8 <T5* + D/A + 1. Thus, 
D < 8(D* + 1) < 16D*. In order words, D = 0{D*). Since, C = D, we obtain: PoA = 
0(D/(C* + D*)) = 0(D*/(C* + D*)) = 0(1). 

By combining the two above cases we obtain the desirable result. ■ 



n 



